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CHAPTER  I 


INTRODUCTION 

Background 

In  order  to  effectively  manage  a  department  from  a 
classical  point  of  view,  it  is  necessary  that  managers 
know  the  objectives  of  the  department;  have  a  means  of 
influencing  input;  have  a  means  of  measuring  output;  and 
have  a  method  of  comparing  measures  of  output  with  orig¬ 
inal  objectives,  so  that  corrective  actions  can  be  imple¬ 
mented  (35:236).  The  objectives  and  units  of  inputs  and 
outputs  are  sometime  not  as  obvious  as  the  previous  stat- 
ment  might  have  implied.  This  is  especially  true  in  the 
RfjD  environment. 

In  the  R§D  environment,  management  is  difficult 
because  of  several  reasons.  First,  upper  level  managers 
sometimes  fail  to  accurately  translate  tiieir  understanding 
of  corporate  objectives  and  goals  into  the  technical  envi¬ 
ronment  (30:8).  This  creates  the  problem  of  an  ill  defined 
objective  and  may  lead  to  interesting  but  undirected  exper¬ 
imentation.  Second,  because  most  of  the  scientists,  engi¬ 
neers,  and  technologists  in  the  R§D  environment  are  moder¬ 
ately  knowledgable  in  their  field  of  discipline,  they  often 
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feel  that  they  should  decide  which  projects  should  be 
undertaken  by  the  organization  (.30:9).  Finally,  K§D 
activities  are  different  when  compared  to  other  activities 
of  business  such  as  proauction  and  office  aamini st rat  ion . 
One  difference  is  that  k§D  success  is  more  dependent  of 
the  individuals  involved  rather  than  the  equipment  used. 

For  example,  in  a  production  process  a  manager  could 
possibly  speed  up  the  flow  rate  of  an  automated  production 
line  if  he/she  desires  more  output.  It  is  a  different 
issue  to  increase  the  thinking  process  of  an  engineer  or 
scientist.  Another  difference  is  that  production  and  some 
adminstrat i ve  processes  are  more  routine  than  those  of 
R§D.  Probably  the' most  important  difference  is  that  it  is 
difficult  to  measure  outputs  of  R§D  activities. 

Because  RfjD  activities  have  unique  characteris¬ 
tics,  appropriate  managerial  techniques  must  be  used  to 
obtain  maximum  benefits  from  limited  resources.  This  need 
for  appropriate  techniques  was  a  catalysis  in  the  creation 
of  approaches  such  as  milestone  charts,  activity  networks, 
and  many  others.  An  investigation  into  the  usefulness  of 
these  techniques  seemed  both  interesting  and  significant. 

In  this  study  some  techniques  applicable  to  R$D  man¬ 
agement  are  reviewed  in  an  attempt  to  identify  how  often 
some  techniques  are  used,  determine  managers  familiarity 
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with  the  techniques,  and  determine  the  usefulness  of  these 
techniques . 

When  probing  the  issue  of  usefulness  of  R$D  manage¬ 
rial  techniques,  several  important  questions  might  arise. 
One  such  question  might  be  whether  the  more  complex  tech¬ 
niques  are  useful  only  for  organizations  with  computer  sup¬ 
port  available  to  them.  If  no  support  is  available,  the 
techniques  may  require  too  much  time  and  effort  to  serve  as 
a  useful  managerial  tool.  A  second  question  might  be 
whether  the  additional  realism  derived  from  using  a  complex 
technique  is  really  worth  it.  For  example,  consider  the 
results  of  a  specific  PERT  network  analysis  first,  manually 
calculated  using  the  original  PERT  procedures,  and  second, 
mechanically  computed  using  Q-GERT,  a  complex  computerized 
technique.  The  network  completion  time  was  estimated  to 
be  29  weeks  (S.D.  8.7)  and  32  weeks  (S.D.  4.7)  using  the 
manual  procedure  and  Q-GERT  respectively.  Is  the  differ¬ 
ence  between  the  estimates  worth  the  additional  expenditure 
of  resources  (i.e.  time,  money,  and  expertise)?  Still 
another  question  might  be  whether  a  simple  heuristic  model 
would  be  just  as  accurate  as  the  complex  techniques  since 
most  of  the  parameters  of  both  techniques  are  estimates. 


Terminology 

Before  discussing  the  techniques  reviewed  in  this 
study,  key  terms  need  be  defined  to  aviod  ambiquity.  Basic 
research  refers  to  research  projects  which  represent  origi¬ 
nal  investigation  for  the  advancement  of  knowledge  which 
has  no  immediate  commercial  objective.  Applied  research 
involves  projects  which  represent  investigation  directed  at 
discovering  scientific  knowledge  which  has  specific  commer¬ 
cial  objectives  (37:4).  Development  for  the  purpose  of 
this  study  is  the  conversion  of  scientific  knowledge  into 
usable  commercial  products  or  processes.  These  terms  are 
similarly  defined  in  Air  Force  regulations,  but  because  of 
the  variation,  Air  Force  definitions  are  also  included. 
Research ,  according  to  AFR  80-1,  is  scientific  study  and 
experimentation  directed  toward  increasing  knowledge  and 
understanding  in  the  sciences  directly  related  to  explic¬ 
itly  stated  long-term  national  security  needs.  Exploratory 
Development  is  a  formal  effort,  ranging  from  fundamental 
applied  research  to  sophisticated  bread-board  experiments, 
to  solve  a  specific  military  problem.  Advanced  Development 
involves  projects  that  have  moved  into  the  development  of 
hardware  for  experimental  or  operational  test.  Engineering 
Development  is  the  final  phase  of  converting  an  idea  into 
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a  usable  commercial  product  (i.e.  a  final  copy  has  been  de 
veloped  and  is  ready  for  production). 

Based  on  a  reveiw  of  literature,  it  was  decided  to 
focus  on  six  common  managerial  techniques  that  are  partic¬ 
ularly  suited  for  the  R§D  environment:  Participative  Ob¬ 
jective  Setting  Techniques  (POST),  Project  Scheduling 
Charts,  Work  Breakdown  Structures  (WBS),  Activity  Net¬ 
works,  Generalized  Activity  Networks,  and  Cost  and  Schedul 
Variance  Analysis. 

POST  are  techniques  whereby  the  managers,  scien¬ 
tists,  engineers,  and  other  key  personnel  jointly  identify 
the  program/project  objectives,  the  objective  of  each 
functional  area,  and  use  the  expected  results  as  a  means 
of  measuring  performance.  The  participative  objective 
setting  approach  in  effect  decentralizes  responsibility 
and  authority  allowing  technical  professionals  to  influ¬ 
ence  the  direction  in  which  the  activities  of  the  organi¬ 
zation  are  geared.  Formal  management  by  objective  systems 
participative  plans  and  meetings,  and  informal  partici¬ 
pative  management  are  examples  of  POST. 

Work  Breakdown  Structure  display  and  define  the 
product(s)  to  be  developed  or  produced  and  relate  the  ele¬ 
ments  of  work  to  be  accomplished  to  each  other  and  to  the 
end  product  (12:2).  The  objective  of  the  WBS  is  to  divide 


the  total  program  or  product  into  smaller  assignable  work 
units.  The  result  is  a  tree-like  diagram  (model  of  the 
project)  of  successive  levels  of  project  work  units  as 
shown  in  Figure  1. 

Project  Scheduling  Charts  are  graphical  represen¬ 
tations  of  activities  and  events  over  a  specified  time 
period.  In  this  technique  time  runs  along  a  horizontal 
graduated  axis  and  activities  are  allocated  to  a  number  of 
horizontal  bars  in  some  appropriate  order.  Events  are 
represented  by  points,  sometimes  triangles  (A),  on  the 
time  scale.  The  list  identifying  the  horizontal  bars  and 
triangles  is  located  along  the  vertical  axis  as  shown  in 
Figure  2.  Performance  is  measured  by  comparing  actual 
accomplishments  with  planned  accomplishments  over  a  spec¬ 
ified  time  period. 

Activity  Networks  can  be  thought  of  as  modified 
project  scheduling  charts  because  in  addition  to  graph¬ 
ically  representing  activities  and  events  over  a  specified 
period  of  time,  activity  networks  identify  all  sequences 
of  activities.  The  network  has  an  arrow  for  each  project 
activity  (31:300).  The  analysis  of  activity  networks 
focuses  on  the  most  time  consuming  path  (the  critical  path) 
through  the  network  as  a  basis  of  planning  and  controlling 
a  project.  An  example  of  an  activity  network  is  shown  in 
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Figure  3.  Program  Evaluation  and  Review  Technique  (PERT) 
and  Critical  Path  Method  (CPM)  are  probably  the  best  known 
activity  networks. 

In  this  study  all  network  techniques  more  complex 
than  PERT/CPM  will  be  considered  Generalized  Activity  Net¬ 
work  techniques.  Generalized  Activity  Network  techniques 
allow  (i)  both  deterministic  and  stochastic  branching, 

(ii)  looping,  (iii)  multiple  sink  nodes,  and  Civ)  other 
complications  not  allowed  in  PERT/CPM  networks  (29:53). 
Events  or  nodes  are  considered  to  have  input  and  output 
sides  which  specify  how  they  interrelate  to  incoming  and 
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outgoing  actions  (branches).  An  example  of  Graphical  Eval¬ 
uation  and  Review  Technique  (GERT),  a  Generalized  Activity 
Network,  is  shown  in  Figure  4. 

Cost  and  Schedule  Variance  Analysis  is  a  technique 
of  planning  and  controlling  by  comparing  planned  resource 
usage  and  achievements  with  actual  expenditures  and  accom¬ 
plishments.  When  the  planned  expenditures  are  plotted 
against  time  as  shown  in  Figure  5,  any  deviations  from  the 
budget  or  schedule  are  readily  recognized.  Cost  and 
Schedule  Variance  Analysis  is  sometimes  used  to  supplement 
other  techniques  since  it  integrates  the  cost  parameter 
with  the  planning  and  controlling  of  the  performance  and 
schedule  parameters  for  R§D  projects. 
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Budgeted  Cost  Work  Performed 


Budgeted  Cost  Work  Scheduled 


Actual  Cost  Work  Performed 


The  objective  of  this  study  is  to  review  the  use  of 
the  R$D  techniques  that  were  discussed  earlier.  More  spe¬ 


cifically,  the  overall  objectives  are  to  determine  how 
familiar  managers  of  a  large  government  R§b  organization 
are  with  these  techniques;  find  out  how  often  these 
techniques  are  being  used;  and  discover  how  useful  these 
techniques  are  in  the  areas  wherein  they  are  being  used. 

Findings  from  this  study  should  enhance  the  under¬ 
standing  of  R§D  management.  Instructors  in  the  management 
field  should  benefit  from  this  study  since  it  will  help 
identify  prominent  techniques  for  specific  areas  of  RfjD 
management . 


Scopes  and  Limitations 

Although  R&D  managers  may  be  concerned  with  a  par¬ 
ticular  product/process  throughout  the  phases  of  its  life 
cycle,  this  study  is  mostly  concerned  with  the  research 
and  design  phase.  This  phase  includes  basic  and  applied 
research  in  engineering,  the  sciences,  and  in  the  design 
and  development  of  a  prototype  and/or  process.  Topics  such 
as  quality  control,  routine  product  testing,  advertising 
research,  marketing  research,  and  research  in  the  social 
sciences  will  not  be  included  in  this  study.  All  of  the 
interviews  involved  employees  of  Wright-Patterson  AFB; 
therefore,  the  study  is  militarily  oriented.  Because  of 
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the  time  allowed  to  complete  this  study,  the  sample  sice 
and  versatility  are  limited  (i.e.  the  study  involved  only 
two  product  divisions].  The  techniques  analyzeu  are 
limited  to  those  introduced..  These  are  not  the  only  manag¬ 
erial  techniques  used  in  R$L)  management,  however,  the  iden¬ 
tified  techniques  appear  to  be  a  representative  sample 
capable  of  accomplishing  the  uescrioed  oojectives. 

Me  t  hodologv 

An  extensive  literature  search  was  conducted  to 
verify  that  the  techniques  used  in  this  study  are  generally 
accepted  as  managerial  techniques  applicable  to  R§D  manage¬ 
ment.  This  literature  search  functioned  as  the  control  of 
the  study  since  this  information  is  mostly  theoretical. 
After  the  search  was  completed,  a  questionnaire  was  design¬ 
ed  to  facilitate  the  interviews.  A  sample  of  the  question¬ 
naire  is  shown  in  the  Appendix. 

The  questionnaire  is  composed  of  two  scales,  a  tech¬ 
nique  familiarity  scale  and  technique  usefulness  scale. 
These  scales  are  used  to  synchronize  the  responses  to  sev¬ 
eral  of  the  questions.  A  list  of  the  techniques  investi¬ 
gated  are  located  on  the  front  page  of  the  questionnaire  in 
the  order  of  increasing  complexity  excluding  the  Cost  and 
Schedule  Variance  Analysis  technique  which  is  the  only- 
technique  discussed  that  emphasizes  the  cost  parameter. 


The  questionnaire  is  also  composed  of  52  items  consisting 
of  9  demographic  items,  6  questions  on  each  technique,  and 
7  questions  that  summarize  the  subjects'  responses. 

Attached  to  the  questionnaire  was  the  recording  sheet  and 
a  brief  description  of  each  technique.  The  questionnaire 
served  the  purpose  of  regulating  the  consistency  of  the 
interviews. 

Upon  completion  of  the  questionnaire,  organizational 
charts  were  obtained  for  Aeronautical  bystem  Division  and 
Air  Force  Wright  Aeronautical  Laboratories  located  here  at 
W'r  ight  -  Pa  1 1  er  son  Air  Force  Base.  These  charts  were  usea  to 
contact  and  set  up  appointments  with  personnel  involved  in 
R$U  management.  Efforts  were  directed  at  interviewing 
only  those  persons  who  had  position  requiring  the  use  of 
managerial  techniques.  After  interviewing  or  contacting 
the  managers  listed  on  the  charts  (.mostly  division  and 
branch  level  persons),  other  lower  level  managers  were 
contacted  through  their  bosses.  Some  of  the  lower  level 
managers  were  reached  by  calling  a  department  and  asking 
for  prospects  until  a  contact  was  made.  All  interview 
were  conducted  on  a  person  to  person  basis.  The  subject 
was  given  a  copy  of  the  questionnaire  so  that  he/she  could 
follow  along  as  the  interviewer  asked  the  questions.  Re- 


sponses  were  immediately  recorded  on  the  sheet  provided 
for  that  purpose. 


The  sampling  procedure  was  a  stratified  plan  where¬ 
in  each  strata  represented  a  particular  RfjD  category. 
Efforts  were  directed  at  selecting  sample  members  from 
each  strata  in  proportion  to  the  cost  of  that  stratum, 
thus  assuring  that  each  strata  was  weighted  in  the  sample 
by  the  cost  associated  with  it.  The  strata  sizes  were 
based  on  the  R&D  spending  trend  for  fiscal  years  1981, 

1982,  and  1983.  It  must  be  noted  that  the  cost  of  a 
project  is  not  always  indicative  of  the  number  of  people 
involved.  However,  by  breaking  the  sample  into  cost  strata 
mo.e  data  points  were  gathered  in  the  more  costly  catego¬ 
ries  of  RfjD.  This  sample  design  seemed  appropriate  for 
the  study  if  the  stated  objectives  were  to  be  achieved. 

Sample  Demographics.  The  sample  consisted  of  60 
managers.  Of  these  managers,  36  were  employed  by  the 
Aeronautical  System  Division  (ASD)  and  24  were  employed  by 
the  Air  Force  Wright  Aeronautical  Laboratory  (AFWAL).  Of 
the  managers  from  ASD,  25  were  military  persons  and  18  of 
the  managers  from  AFWAL  were  civilians.  More  contacts 
were  made  within  ASD  because  it  is  the  largest  product 
division  of  the  Air  Force  Systems  Command  lAFSC)  and  the 
largest  organization  here  at  WPAFB.  With  an  annual  budget 


of  8  billion  dollars,  ASD  manages  the  development  and 
acquisition  of  all  aeronautical  systems  and  related 
equipment  for  the  Air  Force.  AFbAL  links  the  scientists 
and  engineers  in  the  AFSC  laboratories  at  WPAFB  to  ASD  and 
other  AFSC  product  divisions,  ensuring  that  the  results  of 
laboratory  research  and  emerging  new  technologies  are  fully 
used  in  the  development  of  aircraft  and  equipment.  AFlvAL 
works  directly  with  AFSC  headquarters  to  plan  selected 
research  and  engineering  development  as  well  as  exploratory 
and  advanced  development. 

Although  an  attempt  was  made  to  incorporate  all 
levels  of  management,  more  contacts  were  made  with  persons 
at  or  below  the  0-4/GS-14  level.  It  is  believed  that  this 
group  best  represents  the  part  of  the  population  that  is 
responsible  for  "hands-on"  program/project  management.  A 
breakdown  of  the  sample  by  grade  is  shown  in  Table  1. 


TABLE  1 
Grade 


Level  of 
Managment 

Mil 

tf  Managers 

Civ  Total 

Grade 

Lower 

10 

3 

15 

Lt  and  GS-12 

5 

8 

13 

Cap  and  GS-15 

Middle 

10 

7 

17 

Maj  and  GS-14 

Upper 

5 

8 

11 

LtC  and  GS-15 

3 

1 

u 

5 

Col  ana  SEC 

1 

Unknown 

15 
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As  shown  in  Table  1,  431  of  the  managers  were  lower 
level  managers;  28%  were  middle  level  managers;  271  were 
upper  level  managers;  and  2%  were  unknown.  A  higher  per¬ 
centage  of  the  military  persons  were  in  middle  and  lower 
level  management  (52%  and  49%  respectively)  than  were  their 
civilian  counterparts  (25%  middle  and  39%  lower).  The  dif¬ 
ference  between  grades  with  respect  to  familiarity,  fre¬ 
quency  of  use,  and  usefullness  will  be  presented  in 
Chapter  III. 

The  sample  was  composed  of  31  military  persons  and 
29  civilians.  This  information  is  important  when  discuss¬ 
ing  the  distribution  of  job  experience  shown  in  Table  2. 

The  mode  of  this  distribution  was  2.5  years.  The  mean 
number  of  years  of  job  experience  (i.e.  years  in  their 
current  jobs)  was  3.6  years  (S.D.  3.2). 


TABLE  2 

Job  Experience 


#  Managers 

Mi I  Civ  Total 


Years  of  Job 
Experience 


15  2  17 

10  5  15 

4  4  8 

0  7  7 

5  5 

2  6  8 


1  or  less 

2  -  5* 

3  -  4* 

4  -  6* 

6  -  10* 
10  or  more 


Exclusive 


Note  that  only  33%  of  the  managers  had  4  or  more 
years  of  job  experience.  Sixty  two  percent  of  the  civil¬ 
ians  had  4  or  more  years  job  experience,  whereas  only  6%  of 
the  military  managers  had  the  same  number  of  years  job 
experience . 

An  analysis  of  the  demog-aphic  data  revealed  that 
the  majority  of  the  subjects  (managers)  worked  for  ASD; 
about  72a  were  ranked  0-4/GS-14  or  less;  the  number  of  mil¬ 
itary  vs  civilian  persons  was  relatively  even,  however,  ASD 
was  70%  military  and  AFiVAL  was  75%  civilian;  and  66%  of  the 
sample  had  4  or  less  years  experience  at  their  current  jobs. 

Characteristics  of  Projects.  Variables  such  as 
cost;  category  of  R§D;  number  of  people  working  on  the 
program/project;  and  number  of  years  the  project  had  been 
operational  are  important  parameters  in  identifying  a 
project.  Sometimes,  however,  it  is  difficult  to  identify 
which  specific  category  of  R§D  a  project  is  in  because  of 
transitional  periods.  For  example,  during  the  latter 
stages  of  full  scale  development,  the  same  kinds  of  activi¬ 
ties  are  going  on  that  characterize  the  early  production 
phase.  Realizing  this  kind  of  uncertainty,  the  subjects 
were  asked  to  give  "best -guess"  answers  to  questions  about 
the  characteristics  of  the  program  he/she  was  working  on. 

Table  3  displays  the  distribution  of  managers  with 
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respect  to  the  cost  of  their  program/pro  ject  (.  s)  .  Some  of 
the  senior  managers  were  responsible  for  several  projects 
each  of  which  was  usually  managed  by  a  lower  level  manager. 


TABLE  3 
Project  Cost 


#  Managers 

18 

3  or  less 

6 

4  -  6 

8 

7  -  10 

7 

11  -  25 

8 

26  -  "5 

6 

76  -  150 

7 

151  or  more 

As  shown  in  Table  3  most  of  the  managers  were  in¬ 
volved  with  program/projectCs)  costing  less  than  10  million 
dollars.  Of  the  projects  costing  more  that  $10  million,  a 
higher  percentage  of  the  managers  within  a  cost  group  were 
in  the  full  scale  development  phase  or  the  early  production 
phase . 

Table  4  shows  the  distribution  of  managers  with  re¬ 
spect  to  category  of  R§D  that  the  projects  were  in. 


TABLE  4 

Category  of  RfjD 


Category  of  R5D 

#  Managers 

Research 

2 

Exploratory  Development 

10 

Advanced  Development 

12 

Full  Scale  Development 

31 

Early  Production 

5 

Table  5  shows  the  distribution  of  managers  relative 
to  the  number  of  people  here  at  WPAFB  working  on  the  pro¬ 
ject.  The  mean  number  of  years  that  a  project  was  in  exis¬ 
tence  was  5.6  (S.D.  5.2). 


TABLE  5 
Project  Size 


#  People  Involved 

f  Managers 

10  or  less 

27 

11  -  50 

21 

50  -  150 

10 

151  or  more 

After  the  interviews  were  completed,  the  responses 
were  transfered  to  computer  cards  for  analysis.  Cross¬ 
tabulation,  a  program  of  the  statistical  package  for  the 
Social  Sciences  (SPSS),  was  extensively  used  to  aid  in 
analyzing  the  data.  It  should  be  noted  that  the  validity 
of  this  study  is  based  not  only  on  the  methodology  under¬ 
taken,  but  also  the  truthfulness  of  the  respondents.  Ef¬ 
forts  were  taken  to  avoid  fudging  the  data  to  coincide 
with  the  theoretically  implied  applicability  and  useful¬ 
ness  of  the  techniques.  The  theoretical  perspectives  of 
the  techniques  are  discussed  in  the  next  chapter. 
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CHAPTER  11 


THEORETICAL  PERSPECTIVE  OF  TECHNIQUES 
Introduct  ion 

The  descriptions  in  the  preceeding  chapter  of  the 
techniques  being  investigated  were  very  brief  and  probably 
initiated  several  important  questions.  Why  were  these  six 
techniques  chosen?  How  representative  are  these  techniques 
of  all  R§D  managerial  techniques?  Are  the  listed  tech¬ 
niques  indeed  techniques?  The  purpose  of  this  chapter  is 
to  supply  answers  to  the  above  questions  by  rendering  a 
more  detailed  description  of  the  techniques.  Each  tech¬ 
nique  will  be  discussed  to  disclose  strong  points,  most 
applicable  situations,  and  if  applicable,  any  mandatory 
application  required  by  the  Air  Force. 

Participative  Objective  Setting  Techniques. 

When  a  program/project  operates  in  an  environment  of 
uncertainty,  Participative  Objective  Setting  Techniques 
(POSTJ  are  sometimes  appropriate  for  planning  and  control¬ 
ling  organizational  activities  (36:11).  The  idea  phase  of 
creating,  developing,  or  perfecting  a  finished  product  is 
an  example  of  an  environment  of  uncertainty.  This  would 
especially  include  the  Researcn  and  Exploratory  Develop- 


merit  categories  of  R § D  activities  wherein  it  is  usual  to 
find  a  small  group  of  engineers,  scientists,  and  technol¬ 
ogist  working  on  a  project  that  is  in  the  conceptual 
period.  During  this  period  there  is  uncertainty  as  to  the 
feasibility  of  creating  a  final  usable  product. 

As  mentioned  in  Chapter  I,  POST  are  techniques  where 
by  the  managers,  scientists,  engineers,  and  other  key  per¬ 
sonnel  jointly  identify  the  program/project  objectives,  the 
objective  of  each  functional  area,  and  use  the  expected  re¬ 
sults  as  a  means  of  measuring  performance.  These  tech¬ 
niques  provide  much  of  the  freedom  and  flexibility  needed 
by  technical  workers  since  they  allow  the  researchers  to 
participate  in  setting  the  objectives. 

Before  discussing  any  further  the  details  of  POST , 
it  is  necessary  to  point  out  some  differences  between  POST 
and  the  other  techniques  included  in  this  study.  First, 
the  term  technique  is  used  here  in  the  mildest  sense  since 
participative  objective  setting  could  also  be  classified  as 
a  "style"  of  management.  A  management  technique  according 
to  John  Argenti  is  "a  recognized  method  of  analyzing  or 
solving  a  recognized  type  of  management  problem  in  a 
detailed,  systematic  way  [3:5]. 

Some  problems  that  arise  in  R§D  management  are 
first-time  occurrences  which  makes  POST  application 


especially  appropriate.  POST  is  not  recognized  exclusive¬ 
ly  by  this  name  because  it  is  a  derivative  of  such  tech¬ 
niques  or  styles  as  management  by  objective,  participative 
plans  and  meetings,  and  informal  participative  management. 

Second,  POST  is  not  a  tracking  managerial  tool  in 
the  same  sense  as  the  other  techniques.  For  example,  the 
Project  Scheduling  Charts  which  will  be  discussed  later  are 
usually  based  on  some  unit  of  time.  If  the  project  is  be¬ 
hind  schedule  as  far  as  time  is  concerned,  Project  Sched¬ 
uling  Charts  will  point  out  this  shortcoming.  Where  as, 
POST  would  rely  on  previously  set  objectives  to  determine 
if  a  project  is  behind  schedule.  POST  can  be  applied  when 
there  is  not  enough  information  to  formulate  a  Project 
Scheduling  Chart  or  an  Activity  Network.  However,  these 
tracking  systems  can  be  used  to  compliment  POST. 

How  does  POST  actually  work?  These  techniques  are 
characterized  by  three  basic  steps.  First,  realistic  ob¬ 
jectives  are  periodically  established  in  clear  unambiguous 
terms  (19:105).  The  method  of  establishing  the  objectives 
distinguishes  this  technique  of  management  from  the  formal 
management  by  objectives  system.  Program  managers,  scien¬ 
tists,  engineers,  and  other  key  persons  participate  in 
setting  the  objective  of  the  organization,  thus  estab¬ 
lishing  the  direction  in  which  all  efforts  are  geared. 
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Second,  each  element  (scientists,  engineers,  etc.)  identi¬ 
fies  his/her  responsibility  in  realizing  the  established 
objectives  and  sets  out  to  achieve  tnem  (2:48>.  Third,  the 
objectives  are  reviewed  and  evaluated  by  the  participants 
resulting  in  either  continuing  the  effort,  modifing  the 
objectives,  or  formulating  new  objectives.  This  is  a  crit¬ 
ical  step  in  POST  since  it  provides  the  flexibility  requir¬ 
ed  of  all  R$D  techniques.  The  feedback  channel,  a  common 
name  for  this  step,  accomodates  the  changing  of  plans  or 
objectives  characterized  by  an  RqD  environment  and  also 
provides  a  means  of  evaluating  performance.  A  diagram  of 
POST  is  shown  in  Figure  6.  The  shaded  arrows  (Aj  illus¬ 
trate  formal  changes  of  the  organizational  objectives 
which  influences  every  element  and  changes  the  way  perform¬ 
ance  is  measured  since  it  is  done  on  a  comparative  basis. 
The  unshaded  arrows  (A)  represents  informal  communication 
channe 1 s . 


Work  Breakdown  Structures 


The  work  breakdown  structure  (WbSJ  approach  involves 
breaking  a  total  project  up  first  into  major  subunits,  then 
breaking  the  major  subunits  up  into  smaller  units,  and  re¬ 
peated  division  until  the  project  is  broken  down  into 
assignable  work  units.  Like  POST,  WBS  are  useful  tech¬ 
niques  as  an  initial  definition  of  the  work  necessary  to 
begin  implementation  of  a  project.  A  work  breakdown 
structure  is  defined  in  M1L-STD-881A  the  following  way: 


A  product -or i ented  family  tree  composed 
of  hardware,  services  and  data  which  result 
from  project  engineering  efforts  during  the 
development  and  production  of  a  defense 
materiel  item,  and  which  completely  defines 
the  pro j ect/program .  A  WBS  displays  the 
product(s)  to  be  developed  or  produced  and 
relates  the  elements  of  work  to  be  accomplished 
to  each  other  and  to  the  end  product  [ 1 1 :  2  j . 


While  this  definition  is  system-  or  hardware-orient¬ 
ed,  the  WBS  concept  has  a  broader  historical  base,  i.e.  it 
has  wider  applicability  than  just  the  world  of  acquisition 
management . 

The  WBS  approach  provides  a  logical  sequence  of 
breaking  down  a  task,  whether  it  be  a  feudal  tribe  opera¬ 
tion  or  a  modern  program  management  operation  in  the  manner 
in  which  it  must  actually  be  performed.  It  attempts  to 


model  all  the  key  efforts  which  together  constitute  the 
project,  thus  illustrating  the  hierarchial  relationship 
among  these  efforts.  However,  it  should  be  noted  that  all 
relationships  are  not  shown  by  the  WBS  model.  In  the  IvBS 
tree,  Figure  7,  the  relationship  between  system  engineering 
with  flight  test  program,  airframe  and  power  plant  with 
all  other  elements,  flight  control  system  with  integration 
and  assembly,  and  so  on  are  not  indicated.  These 
relationships  could  be  shown  using  techniques  such  as 
activity  networks,  but  are  beyond  the  scope  of  a  KBS 
approach. 

Establishing  the  IVBS  at  too  low  a  reporting  level 
can  cause  distortions  and  difficulties  in  accumulating  and 
reporting  contract  information  (12:2).  it  should  be  ex¬ 
pected  that  the  detail  and  specificity  of  a  IvbS  will  vary 
with  the  site  of  the  project  and  the  phase  of  R5D  wherein 
it  is  applied.  For  example,  for  a  basic  research  project 
employing  only  a  few  persons  with  limited  chores  the  IvBS 
would  probably  include  a  few  generally  stated  work  elements 
broken  down  only  a  couple  of  levels.  As  the  project  pro¬ 
gresses  so  will  the  complexity  of  the  WBS  model.  A  large 
complex  multi-activity  program/project  appears  much  simpler 
to  a  manager  if  he/she  is  able  to  focus  on  individual  sub¬ 
units  of  the  total  program.  The  IvBS  approach  is  a  simple 
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concept,  however,  it  is  powerful  in  facilitating  project 
definition,  initiation  of  efforts,  and  control  of  progress. 

The  UBS  approach  is  mandatorily  applicable  to  each 
of  the  following  types  of  projects: 


(.1]  All  defense  materiel  items  (or  major 
mod i f ica t ions J  being  established  as  an  integral 
program  element  of  the  5-year  defense  program 
(FYDP), 

(2)  All  defense  materiel  items  (or  major 
modifications)  being  established  as  a  project 
within  an  aggregated  program  element  where  the 
project  is  estimated  to  exceed  $10  million  in 
RDT^E  financing,  and 

(5)  All  production  follow-on  of  (1)  and  (2) 
above  [11:7]. 

The  WBS  system  provides  a  basis  for  drawing  networks 
and  for  summarizing  time  status.  However,  the  jasis  of  the 
system  rests  on  the  ability  to  classify  and  form  hierar- 
chial  structures  of  the  pro ject/program  wherein  it  is  being 
applied  (14:3). 


Project  Scheduling  Charts 
Project  scheduling  charts  are  graphical  represen¬ 
tations  of  events  and  activities  ever  a  specified  time 
period.  Like  most  scheduling  techniques  the  major  purpose 
of  project  scheduling  chart  is  to  manage  the  time  allocated 
for  completion  of  a  program/project.  The  two  best  known 
forms  of  project  scheduling  charts  are  probably  the  Gantt 
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chart  and  milestone  chart  both  of  which  operate  on  similar 
basis  (5:251).  However,  each  method  of  scheduling  possess¬ 
es  distinct  characteristics. 

The  Gantt  chart  as  shown  in  Figure  8  is  basically  a 
bar  chart  or  line  chart  with  time  graduations  shown  along 
the  horizontal  axis  and  people,  organizations,  machines,  or 
tasks  shown  along  the  vertical  axis  (31:299).  The  bars  (or 
lines)  show  the  time  units  of  work  that  are  scheduled  for 
each  activity  (person,  task,  organization,  etc.).  Mile¬ 
stone  charts  are  somewhat  like  Gantt  charts,  but  like  the 
name  suggests  milestone  charts  emphasize  particular  events 
over  a  specified  time  period.  Milestones  are  defined  as 
important  accomplishments  necessary  for  the  success  of  the 
project.  Notice  the  similarities  between  the  milestone 
chart  (Figure  9)  and  the  Gantt  Chart  (Figure  8).  In 
Figure  9  the  inverted  triangles  are  objective  milestones 
at  which  progress  is  measured.  Each  time  progress  is  re¬ 
ported,  many  people  must  take  time  to  check  out  and  esti¬ 
mate  percent  completion. 

The  project  scheduling  chart  shown  in  Figure  10  is 
a  combination  of  the  Gantt  chart  and  the  milestone  chart. 
Project  scheduling  charts  are  widely  used  and  popular 
because  they  are  easily  read,  thus  an  excellent  form  of 
communication.  If  project  scheduling  charts  are  employed, 
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Figure  8.  Gantt  Chart.  Source:  AFSCP  800-J,  9  April  1976 
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Figure  9.  Milestone  Chart.  Source:  AFSCP  800-8 ,  9  April  1970 


the  project  director  can  at  any  time  determine  whether  or 
not  the  project  is  progressing  satisfactorily  (22:145). 
However,  these  charts  do  have  some  weaknesses,  two  of 
which  are  inherent.  The  first  weakness  is  that  tne  chart 
becomes  more  useful  as  the  level  of  detail  increases,  but 
this  necessitates  more  line  activities  resulting  in  a 
difficult  chart  to  read.  A  second  weakness  is  that  pro¬ 
ject  scheduling  charts  do  not  show  the  relationship  between 
activities  (31:299).  Consider  the  project  scheduling  chart 
shown  in  Figure  10.  The  relationship  between  training  and 
transportation,  transportation  and  operating  personnel,  and 
so  on  are  not  apparent.  Although  the  scheduler  can  visual¬ 
ize  connections,  the  project  scheduling  chart  cannot  record 
these  connections,  and  the  scheduler  often  may  not  consider 
many  necessary  connections  because  of  the  size  of  the  pro¬ 
gram/project  or  the  degree  of  detail  of  the  chart. 

By  balancing  the  pros  and  cons  of  project  scheduling 
charts,  the  manager  can  create  a  very  useful  tool  to  track 
performance  (i.e.  actual  performance  can  be  compared  to 
scheduled  performance). 

Activity  Networks 


Prior  to  the  advent  of  activity  networks,  milestone 
reporting  was  the  principal  tool  used  to  provide  informa¬ 
tion  on  actual  versus  scheduled  progress  in  ail  assigned 


areas  of  work  (24:150).  If  you  look  closely  at  activity 
networks,  they  are  not  too  different  from  the  old  charting 
techniques.  An  activity  network  drawn  to  time  scale  is  in 
effect  a  bar  graph  which  is  connected  to  show  interrela¬ 
tionships.  Figure  11a  is  an  illustration  of  an  activity 
network  drawn  to  a  time  scale.  The  example  is  the  proce¬ 
dure  of  a  construction  company  constructing  4  residential 
units.  (51:300)  Thus,  activity  networks  can  be  thought  of 
as  modified  project  scheduling  charts  that  in  addition  to 
displaying  a  graphical  representation  of  activities  and 
events  over  a  specified  period  of  time  identify  the 
sequence  of  occurrence. 

The  Critical  Path  Method  (CPM)  and  PERT  are  two  of 
the  best  known  activity  networks  and  will  be  used  in  this 
study  to  represent  the  techniques  of  this  category.  The 
basic  difference  between  the  two  techniques  is  the  fact 
that  PERT  permit  explicit  treatment  of  probability  in  its 
time  estimate  where  as  CPM  does  not  (9:542).  This  distinc¬ 
tion  reflects  PERT's  origin  in  scheduling  advanced  develop¬ 
ment  projects  that  are  characterized  by  uncertainty  and 
CPM’s  origin  in  the  scheduling  of  fairly  routine  activity 
of  plant  maintenance.  However,  for  the  purpose  of  this 
study  PERT  and  CPM  will  be  considered  synonymous 
techniques . 
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Drill  Well 


Figure  11a.  Project  Chart  Drawn  to  Time  Scale 


Activity  networks  focus  on  the  most  time  consuming 
path  through  the  network  as  a  basis  of  planning  and  con¬ 
trolling  a  project.  The  following  steps  are  required  in 
developing  and  solving  an  activity  network  1 5  :  3  4  J . 

1.  Identify  each  activity  to  be  done  in  the 
project.  Care  should  be  taken  to  ensure  that 
these  activities  are  at  the  same  level  of 
detail.  For  example,  in  constructing  a  house 
an  activity  such  as  drill  the  water  well  would 
not  appear  in  the  same  network  as  connect  the 
water  pipes. 

2.  Determine  the  sequence  of  activities  and 
construct  a  network  reflecting  the  precedence 
relationships.  Activity  networks  follow  an 
activity  on  arrow,  event  on  node  structure 

( i . e - ,  arrows  C — *)  denote  activities  and 
nodes  (O  )  denote  events. 

3.  Ascertain  time  estimates  for  each 
activity.  Activity  network  algorithm  requires 
that  three  estimated  be  obtained  for  each 


act i vity : 

o  =  optimistic  time.  The  minimum 
reasonable  period  of  time  in  which 
the  activity  can  be  computed. 
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m  =  most  probable  time.  The  time 
the  activity  will  be  completed 
under  more  realistic  terms, 
p  =  pessimistic  time.  The  maximum 
reasonable  period  of  time  the 
activity  would  take  to  be  completed. 

4.  Calculate  the  expected  time  (ET)  tor  each 
activity.  The  formula  for  this  calculation  is 
as  fol lows  : 

cx  _  0  +  4m  =  P 

'  fa 

This  is  based  upon  the  beta  probability  dis¬ 
tribution  and  weights  the  most  likely  time  (m) 
four  time  more  than  either  the  optimistic  time 
(o)  or  the  pessimistic  time  tp).  (.9:549) 

5.  Determine  the  critical  path.  The  critical 
path  is  the  longest  sequence  of  connected 
activites  through  the  network  and  is  defined 
as  the  path  with  zero  slack  time.  Slack  time 
may  be  thought  of  as  the  amount  of  time  the 
start  of  a  given  activity  may  be  delayed  with¬ 
out  delaying  the  completion  of  the  project 
(52:557-59). 

The  most  straightforward  way  to  understand  activity 
network  is  by  example.  Consider  tne  job  listing  for  com- 


pleting  a  gear  box  (Figure  lib),  and  the  activity  network 
(Figure  11c)  which  illustrates  the  project  graphically.  By 
referring  to  the  normal  job  times  ( ET )  in  Figure  lib,  it  is 
easy  to  establish  the  critical  path.  At  this  point  the 
project  manager  is  ready  to  use  the  network  as  a  tool  for 
planning  and  controlling  the  activities  of  his/her  project. 

Construction,  study,  software,  and  R$D  project 
managers  find  activity  network  to  be  useful  in  the  major¬ 
ity  of  cases  (27:182).  It  is  not  well  suited  to  repetitive 
production  although  it  may  be  used  to  manage  the  production 
of  the  first  article.  The  main  advantage  of  such  a  tech¬ 
nique  is  that  the  network  approach  eliminates  fragmentation 
and  brings  an  integrated  methodology  into  program  planning. 
It  indicates  every  event  critical  for  program  performance 
and  shows  the  activity  time  that  is  needed  before  the  next 
sequential  event(s)  can  take  place  (25:337).  Most  planning 
and  control  systems  also  indicates  time  span  and  sequence, 
but  they  do  not  draw  direct  links  between  the  events,  the 
time,  and  the  responsibility  for  functional  performance. 

Generalized  Activity  Networks 

Realizing  that  there  exist  network  techniques  that 
are  more  sophisticated  than  the  activity  networks  previ¬ 
ously  discussed  necessitates  the  inclusion  of  generalized 
activity  networks  in  this  study.  Generalized  Activity  Net- 
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works  (GAN's)  were  introduced  in  19o4  by  Elmaghrabv  in  an 
effort  to  cope  with  the  problems  of  modeling  realistic 
systems.  Elmaghrabv  generalized  the  structure  of  activity 
networks  when  he  defined  three  types  of  noues:  A.\L)  nodes; 
Exclusive-OR  nodes;  and  Inclusive-OR  noaes. 

1.  The  logical  "A.NLi"  node  (Gj  is  realized  when 
all  activities  leading  into  it  are  realized. 

Thus  the  node  will  oe  realized  at  the  latest 
completion  time  of  the  activities  leading  into 

i  t . 

2.  The  logical  "Inc lus i ve -UR"  node  i  A  j  is 
realized  if  any  one  arc  or  combination  of  arcs 
leading  into  it  is  realized.  Thus  the  node 
will  be  realized  at  the  earliest  completion 
time  of  the  activities  leading  into  it. 

3.  The  logical  "Exclusive-OR"  noae  l  fd  )  is 
realized  if  one  and  only  one  of  the  activities 
leading  into  it  is  realized  (.17:323-30). 

The  following  are  examples  of  GAN  techniques:  Ven¬ 
ture  Evaluation  and  Review  Technique  (VERT),  (28:33) 
Graphical  Evaluation  and  Review  Technique  (GERT),  (3U:s) 
GEi<T  Simulation  (GER'l'S),  (  17.330)  and  t)-GfcRT  (32:15). 

Since  GERI  is  probably  the  oest  known  of  these  techniques, 
it  will  be  used  to  represent  the  GANs. 
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GERT  is  a  generalized  network  technique  allowing 
both  stochastic  and  deterministic  branching,  looping, 
multiple  sink  nodes,  and  specified  realization  times  for 
each  event  ( 1 0 : 1 2 J .  These  characteristics  indeed  enhance 
the  opportunity  for  realism  in  system  modeling;  thus,  de¬ 
serve  a  more  detailed  description.  In  GERT  networks  each 
activity  or  branch  emanating  from  a  node  has  associated 
with  it  the  probability  that  it  will  be  taken.  In  the 
case  of  deterministic  branching,  the  probability  value 
associated  with  each  activity  would  be  one.  As  illustrated 
in  the  figure  below  the  type  of  node,  deterministic  or  pro- 
balistic,  is  identified  by  the  shape  of  the  output  side  of 
the  node. 


branching 


Probabilistic 

branching 


Figure  12.  GAN  Nodes 
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GERT  networks  allow  looping;  thus,  an  activity  can 
be  repeated  and/or  terminated  at  any  event  that  has  already 
been  previously  realized.  Looping  might,  for  example,  be 
included  in  a  network  model  to  depict  the  situation  in 
which  a  student  repeated  a  particular  phase  of  a  training 
program.  GERT  networks  also  allow  multiple  sink  nodes 
(terminal  events!.  For  example,  if  the  project  terminates 
with  the  achievement  of  either  of  the  events,  success  or 
failure,  then  two  sink  nodes  are  appropriate.  GERT  adds 
to  PERT  the  ability  to  explicitly  deal  with  uncertainties 
in  flow  through  the  network;  thus,  establishing  itself  as 
a  specially  useful  technique  when  applied  to  the  planning 
of  R§D  projects  (6:16). 

Consider  a  space  mission  involving  the  rendezvous  of 
two  vehicles.  In  order  for  the  mission  to  have  a  chance 
for  success,  both  vehicles  must  be  successfully  launched. 
Assume  further  that  if  both  vehicles  are  successfully 
launched,  at  least  one  of  the  vehicles  must  be  capable  of 
maneuvering  for  the  mission  to  be  successful.  This  exampJe 
is  graphically  illustrated  in  Figure  13.  Obviously,  the 
example  does  not  supply  a  complete  description;  but  it 
illustrates  some  communication  capabilities  of  GERT. 

One  of  the  main  advantages  of  GAN  techniques  is  the 
ability  to  simulate  project  outcome.  Since  the  network  can 
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allow  management  to  much  more  fully  assess  potential 


Unsuccessful  launch 


Figure  13.  GERT  Source 


Cost  and  Schedule  Variance  Analysis 

Planning  and  controlling  the  project  cost  are  often 
very  important  management  issues.  Some  of  the  techniques 
already  discussed  can  sometimes  be  expanded  to  incorporate 
project  resources  expenditures;  however,  cost  ana  schedule 
variance  analysis  has  the  purpose  of  simultaneously 
planning  and  tracking  a  project's  schedule  and  cost  parame¬ 
ters  to  determine  the  progress  of  the  involved  activities 
(4:38).  This  technique  is  sometime  used  to  supplement 
other  techniques  since  it  integrates  the  cost  parameter 
with  the  planning  and  controlling  of  the  performance  and 
schedule  parameter  for  R§D  projects. 

The  concepts  of  this  technique  are  simple  but  com¬ 
prehensive.  The  cost  and  schedule  variance  analysis  ap¬ 
proach  starts  by  the  identifying  of  functional  units  or 
work  packages.  These  units  which  are  the  basis  for  estab¬ 
lishing  a  time  plan  can  be  identified  using  project  sched¬ 
uling  charts,  WBS,  ANs,  or  other  such  techniques.  The 
second  step  of  this  approach  is  estimating  resource  expend¬ 
iture  on  all  work  packages  relative  to  time  plan  (budget). 
The  budget  is  then  used  as  a  control  or  baseline  for  deter¬ 
mining  progress  and  variance  of  actual  occurrences  (20:54). 
Consider  the  nonrepet  it ive  production  example  presented  in 
Figure  14a.  By  graphing  the  cumulative  cost  of  each  activ- 
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ity  over  the  specified  time  period  the  Budgeted  Cost  of 
Work  Scheduled  l BCW  S )  is  established  (Figure  1 4  b  J .  In 
order  to  determine  the  performance  in  terms  ot  actual  pro¬ 
gress  and  cost,  it  is  necessary  to  derive  the  Budgeted 
Cost  of  Work  Performed  IBCWPJ  ana  the  Actual  Cost  of  Work 
Performed  (ACWP).  Using  these  three  variable  (i.e.  BCWS, 
BCWP,  and  ACWP)  one  can  calculate  the  variance  in  the 
schedule  and  the  cost  which  are  derived  from  formulas  2 
and  3  respectively. 

BCWP  -  BCWS  =  SV  (.schedule  variance)  F-2 

BCWP  -  ACWP  =  CV  (cost  variance)  F-3 

Once  these  variances  are  known  managers  can  sometime 
make  necessary  adjustments  such  that  the  budgeted  schedule 
and  cost  are  maintained.  However,  a  disadvantage  of  the 
Cumulative  Performance  Chart  (Figure  14c)  is  that  is  aoes 
not  emphasize  trends  toward  or  away  from  planned  perform¬ 
ance.  That  is,  the  graphical  representation  does  not  indi¬ 
cate  which  within  a  work  package  is  causing  the  increasing/ 
decreasing  in  cost  or  time  to  completion.  To  answer  this 
question  a  detailed  investigaton  of  each  individual  activ¬ 
ity  would  have  to  be  undertaken.  Another  disadvantage  is 
that  in  the  R§D  environment,  strategies  for  accomplishing 
an  objective  may  change.  Such  changes  mean  changes  to  the 
ba  sel i ne  (  20:35  ). 
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The  Air  Force  requirements  concerning  cost  reports 
are  known  as  the  Cost/Scneuule  Control  System  Criteria 
(C/SCSC).  AFSC  Supplement  1  to  AFR  80U-6  permits  program 
managers  to  require  the  contractor  to  iurmsn  a  monthly 
Cost  Performance  Report  (CPR)  or  a  monthly  Cost/Schedule 
Status  Report  (C/aSRJ  at  lower  thresholds  tnan  specified  in 
AFR  30U-6  (1:3).  However,  either  of  these  reports  inte¬ 
grates  the  contractor's  actual  with  planned  cost  anu 
schedule  performance. 

Cost  and  schedule  variance  anavlsis  is  a  RDhh  imple¬ 
mentation  and  control  technique  which  jointly  considers 
technical  accomplishments,  time,  schedule,  and  resource 
expenditure.  It  should  be  noted  that  this  technique  is 
applicable  to  almost  all  kinds  of  projects  and  can  be  used 
at  many  levels  of  the  program/project. 

Summa  rv 

The  six  techniques  were  chosen  because  of  their 
popularity  and  flexibility.  These  techniques  are  generally 
accepted  (based  on  the  literature  review)  as  being  well 
suited  for  the  RqD  environment.  All  of  tnese  techniques 
are  applicable  to  some  aspect  of  the  program/project 
activities;  however,  none  of  these  techniques  alone  would 
suffice  in  all  possible  R5D  situations.  Therefore,  some 
combination  of  these  techniques  must  be  employed  to  effec- 
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tively  plan  and  control  project  activities. 

Theoretically,  PuST  and  lvi3i>  appear  to  be  more  appro 
priate  techniques  for  planning  and  controlling  project 
activities  during  the  conceptual  phase.  Both  techniques 
operate  on  the  principle  of  decentralization;  thus, 
providing  maximum  flexibility,  responsibility,  and  creativ 
itv  to  the  scientists,  engineers,  and  other  key  persons. 
This  kind  of  environment  is  particularly  important  curing 
the  conceptual  period  of  a  project  (25:287;  50:8). 

Activity  networks  and  project  scheduling  charts  appear  to 
be  more  applicable  to  the  advance  development  and/or  the 
early  production  phase.  Activity  networks  ana  project 
scheduling  charts  operate  on  the  basis  of  some  time  unit; 
therefore,  managers  must  have  at  least  a  moderate  know¬ 
ledge  of  the  critical  activities  required  for  project 
completion  (22:145;  27:182).  GAN  and  cost  and  schedule 
variance  analysis  could  possible  be  applicable  to  acti¬ 
vities  tiiroughout  the  entire  life  cycle  of  the  project. 
Characteristics  such  as  sink  nodes,  looping  activities, 
branching,  and  others  give  GAN  the  capability  of  simula¬ 
ting  even  the  conceptual  period  of  a  project.  A  cost  and 
schedule  variance  analysis  expresses  the  resource  expend¬ 
iture  of  a  project  and  is  thus  applicable  to  most 
situations  (15:14;  1:3). 


One  major  aspect  of  K$D  managment  is  the  orches¬ 
trating  of  these  techniques  so  that  the  project(.s)  operates 
efficiently  and  effectively.  Although  successful  project 
management  is  much  more  than  choosing  managerial  tech¬ 
niques,  the  project  manager's  planning  and  evaluating 
process  is  considerably  more  effective  if  it  uses  the 
right  mix  of  techniques.  .And  while  the  right  set  of 
techniques  certainly  varies  from  project  to  project,  it 
also  does  so  within  the  life  cycle  of  any  given  project 


CHAPTER  III 


ANALYSIS  OF  DATA 

Int  roduc  t ion 

The  purpose  of  this  chapter  is  to  present  the  find¬ 
ings  of  the  study.  In  this  chapter  the  following  issues 
are  discussed:  how  familiar  the  managers  were  with  the 
techniques;  how  often  were  the  techniques  being  used;  how 
useful  were  these  techniques  thought  to  be  in  the  areas 
where  in  they  were  being  used;  the  usefulness  of  the 
various  techniques  relative  to  the  availibility  of  computer 
support;  and  the  primary  techique  used  by  the  managers 
interviewed . 


Familiarity  with  Techniques 
Only  a  few  (10%-15%)  of  the  managers  had  to  refer 
to  the  brief  descriptions  of  the  techniques  attached  to 
the  questions  to  confirm  their  understanding  of  the  tech¬ 
niques.  As  shown  in  Figure  15,  50%  or  more  of  the  man¬ 
agers  of  both  organizations  were  at  least  moderately  know¬ 
ledgeable  about  all  the  techniques  excluding  the  network 
techniques.  Only  42%  of  the  managers  of  AFWAL  were 
moderately  familiar  or  better  with  the  activity  networks. 
This  finding  might  be  indicative  of  the  difference  between 
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lab  activities  and  development  activities.  Managers  of 
neither  organizations  were  familiar  with  GAN  to  a 
significant  degree.  Managers  of  both  ASD  and  AFWAL  were 
more  familiar  with  project  scheduling  charts  than  any  of 
the  other  techniques.  Managers  of  ASD  and  AFWAL  were 


about  equally  familiar  with  POST,  WBS,  and  CSVA. 


Code  Organization  Tota_L 

•  AFWAL  24 

x  ASD  36 


Figure  15.  Familiarity  by  Organization 
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Figure  16  is  a  graphical  representation  of  the  man¬ 
agers'  familiarity,  with  the  techniques  by  grade.  Most  of 
the  managers  were  at  least  moderately  familiar  with  the 
techniques  that  were  investigated.  GAN  were  less  common 
than  any  of  the  others  over  the  entire  range  of  grades.  it 
appears  that  increasing  rank  was  associated  with  increasing 
familiarity.  The  familiarity  with  POST  was  lowest  in  the 
Major  and  GS-14  group  (only  55%  of  this  grade  were 
moderately  familiar  or  better  with  the  technique;  551  of 
the  Lt/GS-12  were  at  least  moderately  familiar  with  the 
technique;  and  the  other  groups  were  relatively  equal  at 
about  80%}.  The  Col/S£S  group  was  much  more  familiar  with 
WBS  than  the  other  groups.  All  of  the  Col/SES  were  at 
least  moderately  familiar  with  WBS.  The  managers  of  all 
grades  were  most  familiar  with  PSC. 

As  shown  in  Figure  17,  most  of  the  managers  (mili¬ 
tary  and  civilian)  were  at  least  moderately  knowledgeable 
about  the  techniques,  excluding  GAN  with  which  the  man¬ 
agers  were  hardly  familiar.  In  most  cases  the  two  groups 
were  relatively  equal  in  familiarity  with  the  techniques. 
Civilian  managers,  however,  were  considerably  more  famil¬ 
iar  with  POST  and  CSVA  than  were  their  military  counter¬ 


parts. 


Moderately  Knowledgeable  or  Better 
Yotal  Managers  "  ~ 


Grade 

Lt/GS-12 

Capt/GS-13 

Maj/GS-14 

LtC/GS-15 

Col/SES 


Total 

13 

13 

17 

11 

5 


Figure  16.  Familiarity  by  Grade 
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Figure  17.  Familiarity  by  Military  Status 


Frequency  of  Use 

As  shown  in  Table  6,  project  scheduling  charts  were 
used  by  more  managers  for  both  planning  and  controlling 
than  any  of  the  other  techniques.  Only  1  of  the  60 
managers  indicated  that  PSC  were  never  used.  Next  to  PSC, 
WBS  were  used  by  more  managers  that  were  the  other 
techniques.  POST  followed  IV BS  in  the  number  of  managers 
that  use  it.  CSVA ,  AN ,  and  GAN  ranked  fourth,  fifth  and 
sixth  respectively  in  the  number  of  managers  using  them. 
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TA BLL  t> . 

Ft  equeuc y  of  Use 


reclinioue 

Frequency 

of  Use 

POST 

Never 

Occa  s i cna  1  1  v 

Often 

A 1  wa  v  s 

Plan 

1  7 

15 

19 

1 l‘ 

Control 

1  7 

17 

1  7 

y 

PSC 

Plan 

1 

10 

1  9 

5  0 

Cont  ro 1 

1 

1 1 

25 

25 

UBS 

Plan 

1  1 

24 

19 

6 

Control 

10 

27 

1  6 

7 

AN 

Plan 

5  5 

18 

- 

7 

Control 

3  7 

14 

0 

3 

GAN 

Plan 

S3 

5 

0 

0 

Cont ro  1 

3  6 

4 

0 

0 

CSV. A 

r  1 ,1  P 

1  5 

16 

- 

oc n  t  ro  1 

1  8 

18 

14 

10 

<  t.  i  ;■ 

•  t ■  •  net  wo 

r as  wore 

use a  by  less 

than  50 

"s  of  tne 

ma  na  gets. 

Apr rc x  i na  : 

ely  5  V  » 

of  the  managers  never 

usee  AN 

and  almost 

9  3  s  never 

used  CAN 

Ihe  rankings  were 

the  same 

tor  both  the  planning  and  controlling  of  project  activ¬ 
ities.  Note  tnat  all  of  tne  techniques  were  used  to  some 
deg  ree . 

Twenty  five  percent  of  the  managers  indicated  that 
they  were  using  techniques  that  were  not  included  in  the 
study.  A  list  of  the  other  techniques  included  the  follow¬ 
ing:  Fleuristic  (8),  Plans  S  Meetings,  Road  Maps  II),  Man¬ 

agement  Control  System,  Management  Assessment  Report, 

Formal  Management  by  Objective,  and  Versions  of  CSV  A  (Cost 
Performance  Report  and  Cost/Schedule  Control  System  Crite¬ 
ria).  The  frequency  of  occurrence  is  indicated  by  the 
number  in  parentheses. 


Usefulness  of  Techniques 

The  degree  of  usefulness  appears  to  vary  directly 
with  the  frequency  of  use  (i.e.  a  technique  that  was  used 
frequently  got  a  higher  usefulness  rating  than  a  technique 
that  was  not  used  quite  as  often).  As  shown  in  Table  7a, 
project  scheduling  charts  and  POST  were  the  only  techniques 
that  had  50%  or  more  of  the  managers  using  them  to  indicate 
that  these  techniques  were  better  than  average  planning 
techniques.  The  usefulness  of  UBS,  CSVA,  and  AN  were  ranked 
relatively  equal  as  planning  techniques.  Table  7b  show? 
that  project  scheduling  charts  and  CSVA  were  the  two  tech¬ 
niques  which  received  similar  high  ratings  as  control 
techniques.  The  usefulness  of  POST,  Ubi.  ana  AN  were  ranked 
relatively  equal  as  control  techniques.  GAN  were  rated 
last  in  both  planning  and  controlling  categories. 

It  must  be  noted  that  the  ranking  process  mentioned 
above  did  not  take  into  account  the  number  of  people  actu¬ 
ally  using  the  techniques  or  did  it  weigh  various  useful¬ 
ness  rating  differently.  The  ranking  process  shown  in  Table 
8a  attempts  to  incorporate  these  two  factors.  ihe  major 
differences  in  the  results  of  this  measure  of  usefulness 
are  that  (i)  PSC  is  ranked  much  higher  than  PubT  as  a 
planning  technique  when  the  number  of  managers  using  t:ie 
techniques  are  considered,  and  (ii)  AN  were  not  ranr.e..  as 


TABLE  7a 

Usefulness  tor  Planning 


Plan 

POST 

PSC 

h  BS 

AN 

GAN 

CSVA 

No  Use 

- 

.  04  1 

.057 

- 

Some  Use 

.  116 

.068 

.  204 

.259 

.600 

.152 

Same  As 

.  116 

.  237 

.286 

.333 

.200 

.395 

More  Useful 

.419 

.254 

.204 

.259 

.200 

.184 

Very  Useful 

.  279 

.407 

.245 

.111 

- 

.289 

Best 

.070 

.  054 

.020 

- 

- 

TABLE  7b 

Usefulness  for  Controlling 


Cont  rol 

POST 

PSC 

UBS 

AN 

GAN 

CSVA 

No  Use 

.016 

.060 

.  045 

- 

Some  Use 

.  186 

.102 

.180 

.261 

.250 

.  143 

Same  As 

.  349 

.254 

.304 

.500 

.  258 

More  Useful 

.233 

.288 

.180 

.304 

.250 

.238 

Very  Useful 

.  209 

.322 

.220 

- 

.355 

Best 

.023 

.017 

- 

- 

.048 

TABLE  8a 

Usefulness  Ranking 


Technique 

Total 

#  Using  Mgrs 

Ranking 

Used 

Plan 

Control 

Plan 

Control 

POST 

4  3 

4  3 

8.95 

5 .51 

PSC 

59 

59 

13.  A 

8.78 

WBS 

49 

50 

7.95 

7  .75 

AN 

27 

25 

5.60 

3.23 

GAN 

5 

4 

0.45 

0.40 

CSVA 

38 

4  2 

6.65 

8.07 

close  to  the  other  techniques  in  either  planning  or  control¬ 
ling  when  the  number  of  users  and  the  usefulness  ratings 
were  considered. 


An  investigation  _nto  the  usefulness  of  the  tech¬ 
niques  with  respect  to  the  availability  of  computer  support 
indicated  that  no  relationship  existed  in  most  of  the  cases. 

Bach  ranking  index  is  the  product  of  the  "usefulness" 
1,  2,  5,  4,  5,  6,  the  "frequency  of  usefulness"  -  2,  5,  4, 
and  percent  in  each  cell.  For  example,  consider  the  calcu¬ 
lation  of  the  POST  plan  index.  Table  8b  shows  the  distribu¬ 
tion  of  the  management  responses  and  the  procedure  for 
calculating  ranking  indices. 

TABLE  8b 

POST  Planning  Ranking 


C^sarne  f ,  •>  same  ,  ,  •>  more  ,  _  >  very 
u  use  J  as  others  "useful  "useful 


(  6 ) be  st 


(2)  Occasional  54  310 

(3)  Often  00  11  7  1 

(4J  Always _ 0 _ 1 _ 4 _ 4 _ 2 


(2)(2)(5/60)  =  .535  (3)12)10/60)  =  0  14jl2J(0/60j  =  0 

(2H3H4/60)  =  .400  (5)(3)(  0/60)  =  0  UH3H  1/60)  =  .200 

1 2 ) ( 4 ) ( 3/ 60  )  =  .400  (3)(4)tll/60)  =  2.20  l4JU)C4/60J  =  1.07 

( 2 ) C  5  ) (  1/60  )  =  .  167  (3)(5)(7/60)  =  1.75  1  4  )15)14/60)  =  1.35 

(  2  )  1  6)  10/60)  =  0  15)  16  )(  1/60J  =  0.30  14  )‘16  J  ( 2/60  j  =  0.80 

1.30  4.25  5.40 

Total  =  8.95 


Primary  Techniquels) 

The  managers  interviewed  were  asked  to  identify  the 


primary  technique  or  combination  of  techniques  that  they 
were  using  for  planning  and  controlling  purposes.  Table  9 
shows  their  responses. 


TABLE  9 

Primary  Techniques 


PLANNING 

CONTkuLLlNG 

Frequency 

Technique! s ) 

Frequency 

Technique(sJ 

26 

PSC 

21 

PsC 

18 

POST 

16 

CSVA 

4 

WBS  8  PSC 

1  1 

PuST 

5 

AN 

3 

IvBS  8  PSC 

L 

CSVA 

2 

»« 

l 

POST  8  WBS 

1 

WBS  8  CSVA 

l 

POST  8  PSC 

1 

PSC,  WBS,  CSVA 

l 

PSC,  WBS,  CSVA 

1 

AN  8  PSC 

l 

WBS 

AN  8  CSVA 

l 

WBS,  AN,  CSVA 

1 

GAN 

2 

No  Response 

1 

CSVA  8  PSC 

1 

No  Response 

As  shown  in  Table  9,  55%  of  the  managers  were  using 
project  scheduling  charts  alone  or  with  other  techniques 
as  a  primary  means  of  planning  their  project  activities. 

Of  the  managers,  33%  were  using  POST  or  some  combination 
including  POST  as  a  primary  technique  for  planning  their 
project  activities.  WBS,  CSVA,  AN  and  GAN  were  seldom  used 
as  primary  planning  techniques. 

Of  the  managers,  45°$  used  PSC  or  some  combination 
including  PSC  as  a  primary  control  technique;  35%  useu  CSVA 
alone  or  with  other  techniques  as  a  primary  means  of  con¬ 
trolling  their  project  activities.  About  18%  used  POST; 
the  remaining  techniques  were  seldom  used. 
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The  managers  were  also  asked  to  identify  those  tech¬ 


niques  that  should  be  their  primary  means  of  planning  and 
controlling.  These  responses  shown  in  Table  y.  This 
occurrence  indicated  that  the  managers  felt  t  ha  t  they  were 
using  the  most  appropriate  technique. 


CILAPThR  IV 


DISCUSSION  AND  CONCLUSIONS 
Summa  ry 


Because  the  activities  of  research  and  development 
management  are  different  from  those  of  management  in  gen¬ 
eral,  so  must  the  techniques  that  are  used  to  plan  and 
control  these  activities  be  different.  Six  Techniques 
considered  to  be  particularly  suited  for  Rf,U  management 
were  investigated  to  determine  how  familiar  managers  were 
with  these  techniques;  how  often  they  used  these  tech¬ 
niques;  and  how  useful  were  these  techniques  in  the  areas 
wherein  they  were  being  applied.  The  following  techniques 
were  investigated  in  this  study:  Participative  Objective 
Setting  Techniques,  Project  Scheduling  Charts,  l\ork  Br ea  k  - 
down  Structures,  Activity  Networks,  Generalized  Activity- 
Networks,  and  Cost  and  Schedule  Variance  Analysis.  The 
complexity  of  these  techniques  range  from  the  simple  bar 
graph  of  the  project  scheduling  charts  to  the  computerized 
probabilistic  network  system  of  the  generalized  activity- 
networks  . 

To  accomplish  the  objectives  of  determining  the  ise- 
fulness,  familiarity,  and  frequency  of  use,  60  managers  at 
a  large  government  R§D  installation  were  interviewed.  More 
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specifically,  the  sample  consisted  of  56  managers  in  the 
development  area  and  24  managers  concerned  with  laboratory 
activities. 


The  managers  were  most  familiar  with  the  project 
scheduling  charts  and  least  familiar  with  the  generalized 
activity  networks.  Managers  were  about  equally  familiar 
with  the  remaining  four  techniques.  Project  Scheduling 
Charts  were  also  used  more  frequently  than  the  other  tech¬ 
niques  and  were  rated  the  most  useful  of  the  six  techniques 
for  both  planning  and  controlling  project  activities.  Gen¬ 
eralized  activity  networks  were  used  less  frequently  than 
the  others  and  were  rated  the  least  useful  of  the  six 
techniques  for  both  planning  ana  controlling  purposes. 

PSC  followed  POST  in  rank  as  a  planning  technique  when 
frequency  of  use  and  usefulness  rating  were  considered. 

Cost  and  schedule  variance  analysis  followed  PSC  in  rank 
as  a  control  technique.  Activity  networks  were  ranked 
next  to  last  in  all  cases. 

There  was  no  significant  relationship  between  the 
usefulness  of  the  techniques  and  the  availibility  of  com¬ 
puter  support.  The  techniques  that  usually  make  use  of 
the  computer  were  the  lowest  rated  in  usefulness,  frequency 
of  use,  and  managers'  familiarity  with  them. 


Although  KBS  were  usea  rather  frequently,  only  a 
small  percentage  of  the  managers  considered  it  a  primary 
planning  or  control  technique.  More  managers  identified 
PSC  as  their  primary  planning  and  control  technique  than 
any  of  the  others.  PCS!  and  CSVA  were  next  to  PSC  in  plan 
ning  and  controlling  respectively. 

Conclusions 

This  study  clearly  is  not  the  "absolute  statement" 
about  R$D  management  techniques  since  this  study  is  basea 
on  only  60  interviews  at  a  single  government  R&b 
installation.  However,  this  study  should  serve  the 
purpose  of  furnishing  some  insight  as  to  which  techniques 
are  useful  in  R$D  management. 

At  the  government  installation  studied  the  simplest 
technique,  project  scheduling  charts,  was  found  to  be  more 
useful  than  the  more  complex  techniques.  it  appears  that 
as  the  complexity  of  the  techniques  increased  their  useful 
ness  decreased.  The  high  rating  of  POST  as  a  planning 
technique  indicated  a  decentralized  planning  process  which 
incorporated  the  expertise  of  key  employees.  It  appears 
that  the  cost  parameter  is  very  important  when  attempting 
to  control  project  activities.  This  is  attested  to  by  the 
high  rating  of  CSVA  as  a  control  technique.  The  conven- 
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ience  of  computer  support  was  insignificant  in  altering 
the  way  managers  jo  their  joos. 

Kecommenda t  ions 

A  stuuy  that  incorporated  more  R£D  managers  from 
both  the  government  and  industry  environments  could  be 
undertaken  in  order  to  be  able  to  draw  more  general 
conclusions  about  Rf,D  management  techniques.  Also,  it 
would  be  interesting  to  investigate  the  relationship 
between  categories  of  R§D  (.  i  .  e .  basic  reseach,  applied 
research,  and  developmental  research)  and  the  technique 
used  . 
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Appendix 

Sample  Interview  Formats 
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When  a  program  or  project  operates  in  an  environment 
of  uncertainty,  Participative  Objective  Setting  Techniques 
are  sometimes  appropriate  for  planning  and  controlling  program/ 
project  activities.  The  term  tech.n lgue  is  used  here  in  the 
mildest  sense.  Since  participative  objective  setting  could 
also  be  classified  as  a  "style". 

Participative  Objective  Setting  Techniques  are  tech¬ 
niques  whereby  the  managers,  scientists,  engineers,  and  other 
key  personnel  jointly  identify  the  program/project  objectives, 
the  objective  of  each  functional  area,  and  use  the  expected 
results  as  a  means  of  measuring  performance.  The  participa¬ 
tive  objective  setting  approach  in  effect  decentralizes 
responsibility  and  authority  allowing  technical  professionals 
to  influence  the  direction  in  which  the  activities  of  the 
organization  are  geared.  Formal  management  by  objective 
systems,  participative  plans  and  meetings,  and  informal  par¬ 
ticipative  menagement  are  examples  of  Participative  Objective 
Setting  Techniques. 
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Project  Scheduiina  Charts 


Project  Scheduling  Charts  are  graphical  representa¬ 
tions  of  activities  and  events  over  a  specified  tine  period. 
In  this  technique  time  runs  along  a  horizontal  graduated  axis 
and  activities  are  allocated  to  a  number  of  horizontal  bars 
m  some  appropriate  order.  Events  are  represented  by  points, 
sometimes  triangles  (  ) ,  On  the  time  scale.  The  list  of 

activities  and  events  identifying  horizontal  bars  and  tri¬ 
angles  respectively  is  along  the  vertical  axis  as  shown  in 
the  figure  below.  Performance  is  measured  by  comparing 
actual  accomplishments  with  planned  accomplishments  over  a 
specified  time  period. 


Work  Breakdown  Structure 


A  Work  Breakdown  Structure  (WBS)  displays  and  defines 
:se  product (s)  to  be  developed  or  produced  and  relates  the 
element  of  work  to  be  accomplished  to  each  other  and  to  the 
end  product.  (Source  Military  Standard  681A.)  The  objective 
of  the  WBS  is  to  divide  the  total  program/project  or  product 
into  smaller  assignable  work  units.  The  result  is  a  tree¬ 
like  diagram  (model  of  the  project)  of  successive  levels  of 
project  work  units  as  shown  in  the  figure  below. 


FC5  Entlneerina  Assessment 


i  V 


Activity  Networks 

Activity  Networks  can  be  thought  of  as  modified  pro¬ 
ject  scheduling  charts  because  in  addition  to  graphically 
representing  activities  and  events  over  a  specified  period 
of  time,  Activity  Networks  identify  ail  sequences  of  acti¬ 
vities.  The  network  has  an  arrow  for  each  project  activity. 
The  analysis  of  Activity  Networks  focuses  on  the  most  time- 
consuming  path  (the  critical  path)  through  the  network  as  a 
basis  of  planning  and  controlling  a  project.  An  example  of 
an  Activity  Network  shown  in  the  figure  below,  Program  Eval¬ 
uation  and  Review  Technique  (PERT)  and  Critical  Path  Method 
(CPM)  are  probably  the  best  known  Activity  Networks. 


iques  more  complex 


In  this  study  all  network  tech.n 
than  PERT/CPM  in  their  basic  forms  will  bo  considered  a  Gen¬ 
eralized  Activity  Network  technique.  Generalized  Activity 
Net-work  techniques  allow  (i)  both  deterministic  and  stochas¬ 
tic  branching,  (ii)  looping,  (iii)  multiple  sink  nodes,  and 
( iv)  other  complications  not  allowed  in  PERT/CPM  networks. 
Events  or  nodes  are  considered  to  have  input  and  output  sides 
which  specify  how  they  interrelate  to  incoming  and  outgoing 
actions  (branches) .  The  following  techniques  are  examples 
of  General  Activity  Networks:  Graphical  Evaluation  and 
Review  Techniques  Simulation  (GERTS)  ,  Venture  Evaluation  and 
Review  Technique  (VERT) ,  Q-GERT,  and  GERT.  An  example  of 
GERT,  a  Generalized  Activity  Network,  is  shown  in  the  figure 
below . 


Scrip 


planning  and  controlling  by  comparing  planned  resource  usage 
and  achievements  with  actual  expenditures  and  accomplishments 


When  the  planned  expenditures  are  plotted  against  time  as 
shown  in  the  figure  below,  any  deviations  from  the  budget  or 
schedule  are  readily  recognized.  Cost  and  Schedule  Variance 
Analysis  is  sometimes  used  to  supplement  other  techniques 
since  it  integrates  the  cost  parameter  with  the  planning  and 
controlling  of  the  performance  and  schedule  parameters  for 


R&D  projects. 


Technique  Familiarity  Scale  (Scale-1) 


(1  )  I  have  never  heard  of  it  before. 

(2)  I  have  heard  of  it  before,  but  do  not  know  any  details 
about  it. 

(3)  I  have  a  little  knowledge  of  it  (i.e.,  I  have  read  or 
talked  to  others  about  it). 

(i|.)  I  am  moderately  knowledgeable  about  it. 

(5)  I  consider  myself  very  knowledgeable  about  this  technique 

(6)  I  consider  myself  an  expert  on  this  technique. 

Technique  Usefulness  Scale  (Scale-2) 

( 1 )  Is  of  no  use. 

(2)  Is  of  some  use,  but  not  as  useful  as  other  techniques. 

(3)  About  as  useful  as  other  techniques. 

U).)  Is  more  useful  than  other  techniques. 

(5)  Is  a  very  useful  technique,  far  more  so  than  others. 

(6)  Is  the  best  technique. 

Techniques  Being  Investigated 

(1 )  Participative  Objective  Setting 

(2)  Work  Breakdown  Structures 

(3)  Project  Scheduling  Charts 
(U)  Activity  Networks 

(5)  Generalized  Activity  Networks 

(6)  Cost  and  Schedule  Variance  Analysis 
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Name : 


Organization : 
Grade : 

Job  Title: 


1 .  How  long  have  you  held  your  present  job? 

2.  What  is  the  approximate  cost  of  the  program/project  that 
you  are  working  on?  (Total  RDT&E  costs) 

3.  What  is  the  approximate  number  of  people  here  at  WPAF3 
who  work  on  this  program/project? 

it..  Which  of  the  following  best  describes  the  activities  of 
your  organization? 

a.  Research 

b.  Exploratory  Development 

c.  Advanced  Development 

d.  Engineering  Development 

e.  Other _  (  specify ) 

5.  How  long  has  your  program/project  been  in  operation? 

6.  How  familiar  are  you  with  Participative  Objective  Setting 

Techniques?  (Use  Scale-1  )  1  2  3^56 

7.  Have  you  had  any  training  in  using  the  above  technique? 
Was  this  training 

a.  college 

b.  short  course 

c.  OJT 

d.  PME  (e.g.  SOS,  ACSC) 

8.  Is  Participative  Objective  Setting  used  to  plan  your 
project/program  activities? 

a.  Never 

b.  Occasionally 

c.  Often 

d.  Always 

9.  Is  Participative  Objective  Setting  used  to  control  your 
program/project  activities? 

a.  Never 

b.  Occasionally 

c.  Often 

d.  Always 
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10.  Kow  useful  do  you  think  is  the  Participative  Objective 

Setting  Technique  in  planning  your  program/project 
activities?  (Use  Scale-2)  1  2  3  4  5 

11.  How  useful  do  you  think  is  the  Participative  Objective 

Setting  Technique  in  controlling  your  project/program 
activities?  (Use  Scale-2)  1  23456 

12.  How  familiar  are  you  with  Project  Scheduling  Charts? 

(Use  Scale-1 )  1  23456 

13.  Have  you  had  any  training  in  using  the  above  technique? 

Was  this  training 

a.  college 

b.  short  course 

c.  OJT 

d.  PME  (e.g.  SOS,  ACSC) 

14-  Are  Project  Scheduling  Charts  used  to  plan  your  program/ 
project  activities? 

a.  Never 

b.  Occasionally 

c.  Often 

d.  Always 

15.  Are  Project  Scheduling  Charts  used  to  control  your  program/ 
project  activities? 

a.  Never 

b.  Occasionally 

c.  Often 

d.  Always 

1  6.  How  useful  do  you  think  are  Project  Scheduling  Charts  in 
olanning  your  program/project  activities? 

(Use  Scale-2)  *123456 

17.  How  useful  do  you  think  are  Project  Scheduling  Charts  in 
controlling  your  program/project  activities? 

(Use  Scale-2)  1  23456 

18.  How  familiar  are  you  with  Work  Breakdown  Structure? 

(Use  Scale-1 )  1  23456 

19.  Have  you  had  any  training  in  using  the  above  technique? 

Was  this  training 

a.  college 

b.  short  course 

c.  OJT 

d.  PME  (e.g.  SOS,  ACSC) 
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20.  Are  Work  Breakdown  Structures  used  to  plan  your  project/ 
program  activities? 

a.  Never 

b.  Occasionally 

c.  Often 

d.  Always 

21 .  Are  Work  Breakdown  Structures  used  to  control  your  program/ 
project  activities? 

a.  Never 

b.  Occasionally 

c.  Often 

d.  Always 

22.  How  useful  do  you  think  are  Work  Breakdown  Structures  in 
planning  your  program/project  activities? 

(Use  Scale-2)  1  2  3  4  5  6 

23.  How  useful  do  you  think  are  Work  Breakdown  Structures  in 
controlling  your  program/project  activities? 

(Use  Scale-2)  1  2  3  4  5  6 

24*  How  familiar  are  you  with  Activity  Networks? 

(Use  Scale-1 )  1  2  3  4  5  6 

2 5.  Have  you  had  any  training  in  using  the  above  technique? 

Was  this  training 

a.  college 

b.  short  course 

c.  OJT 

d.  PME  (e.g.  SOS,  ACSC) 

26.  Are  Activity  Networks  used  to  plan  your  program/project 
activi ties  ? 

a.  Never 

b.  Occasionally 

c.  Often 

d.  Always 

27.  Are  Activity  Networks  used  to  control  your  program/project 
activities? 

a.  Never 

b.  Occasionally 

c.  Often 

d.  Always 

26.  How  useful  do  you  think  are  Activity  Networks  in  planning 
your  program/project  activities? 

(Use  Scale-2)  1  23456 


75 


39.  Is  Cost  and  Schedule  Variance  Analysis  used  to  control 
your  program/project  activities? 

a.  Never 

b.  Occasionally 

c.  Often 

d.  Always 

1+0.  How  useful  do  you  think  is  Cost  and  Schedule  Variance 
Analysis  in  planning  your  program/project  activities? 

(Use  Scale-2)  1  2  3  1+56 

i+1  .  How  useful  do  you  think  is  Cost  and  Schedule  Variance 

Analysis  in  controlling  your  program/pro ject  activities? 

(Use  Scale-2)  1  2  3  k  5  6 

1+2.  Do  you  have  computer  support  for  such  techniques  available 
to  you  for  planning  and  controlling  purposes? 

1+3.  What  is  (are)  the  primary  technique  (s)  used  on  your  program/ 
project  for  planning? 

1+1+.  What  is  (are)  the  primary  technique(s)  used  on  your  program/ 
project  for  controlling? 

1+5.  What  other  technique(s)  do  you  use? 

1+6.  What  do  you  think  should  be  the  primary  technique  (s)  for 
planning  your  prograra/pro ject  activities? 

1+7.  What  do  you  think  should  be  the  primary  technique (s)  for 
controlling  your  program/project  activities? 

1l8.  Do  you  know  anyone  else  who  uses  any  of  these  techniques? 
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How  useful  do  you  think  are  Activity  Networks  in  controlling 
your  program/project  activities? 

(Use  Scale-2)  1  2  3  4  5  6 

How  familiar  are  you  with  Generalized  Activity  Networks? 

(Use  Scale-1 )  1  2  3  U  5  6 

Have  you  had  any  training  in  using  the  above  technique? 

Was  this  training 

a.  college 

b.  short  course 

c.  OJT 

d.  PME  (e.g.  SOS,  ACSC) 

Are  Generalized  Activity  Networks  used  to  plan  your  program/ 
project  activities? 

a.  Never 

b.  Occasionally 

c.  Often 

d.  Always 

Are  Generalized  Activity  Networks  used  to  control  your 
program/project  activities? 

a.  Never 

b.  Occasionally 

c.  Often 

d.  Always 

How  useful  do  you  think  are  Generalized  Activity  Networks 
in  planning  your  orogram/pro ject  activities? 

(Use  Scale-2)  i  2  3  4  5  6 

How  useful  do  you  think  are  Generalized  Activity  Networks 
in  controlling  your  orogram/pro ject  activities? 

(Use  Scale-2)  12  3  4  5  6 

How  familiar  are  you  with  Cost  and  Schedule  Variance  Analysis 
(Use  Scale-1 )  1  23456 

Have  you  had  any  training  in  using  the  above  technique? 

Was  this  training 

a.  college 

b.  short  course 

c.  OJT 

d.  PME  (e.g.  SOS,  ACSC) 

Is  Cost  and  Schedule  Variance  Analysis  used  to  plan  your 
pro ject/program  activities? 

a.  Never 

b.  Occasionally 

c.  Often 

d.  Always 
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